Regular Boundary Points in Markov Chains
نویسندگان
چکیده
منابع مشابه
Detecting change-points in Markov chains
Markov chains provide a flexible model for dependent random variables with applications in such disciplines as physics, environmental science and economics. In the applied study of Markov chains, it may be of interest to assess whether the transition probability matrix changes during an observed realization of the process. If such changes occur, it would be of interest to estimate the transitio...
متن کاملVerifying ω-Regular Properties of Markov Chains
In this work we focus on model checking of probabilistic models. Probabilistic models are widely used to describe randomized protocols. A Markov chain induces a probability measure on sets of computations. The notion of correctness now becomes probabilistic. We solve here the general problem of lineartime probabilistic model checking with respect to ω-regular specifications. As specification fo...
متن کاملEmpirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملOn the Martin Boundary for Markov Chains.
wide compared with the length of the specimen, and so is the angle between the lateral edge of the kink band and the axis of extension, E = [sin xo/sin (xi + so) ] 1. (2) For narrow kink bands and deformation bands, (a) an approximate relation is s = cot (900 w); (b) a more precise relation where a and ,3 are the respective angles between the kink-band boundary and the active glide plane in the...
متن کاملRegular Perturbation of V-Geometrically Ergodic Markov Chains
In this paper, new conditions for the stability of V -geometrically ergodic Markov chains are introduced. The results are based on an extension of the standard perturbation theory formulated by Keller and Liverani. The continuity and higher regularity properties are investigated. As an illustration, an asymptotic expansion of the invariant probability measure for an autoregressive model with i....
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the American Mathematical Society
سال: 1966
ISSN: 0002-9939
DOI: 10.2307/2035184